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METHOD AND DEVICE FOR INTERPRETING 
CONCEPTS AND CONCEPTUAL THOUGHT 
FROM BRAINWAVE DATA AND FOR ASSISTING 
FOR DIAGNOSIS OF BRAINWAVE DISFUNCTION 


BACKGROUND OF THE INVENTION 


1. Field of the Invention 

This invention relates to the field of neuroscience and 
more particularly relates to the application of human 
brain wave analysis including quantitative electroen- 
cephalography. More particularly, the present inven- 
tion relates to conceptual interpreters and conceptually 
driven interfaces. 

2. Discussion of the Background 

Electrical brain activity can be detected using elec- 
trodes placed on the scalp of a human subject. An elec- 
troencephalogram (EEG) is a recording of a time-vary- 
ing spontaneous potential (SP) that is obtained from an 
alert and resting subject. When a subject is presented 
brief sensory stimuli (e.g., a flash, a click, a mild shock 
to the skin), a time-varying evoked potential (EP) is 
superimposed upon the normally present SP so that the 
EEG voltage includes both SP and EP components. 
The EP waveform begins within a few milliseconds 
after receipt of a sensory stimulus, and continues with a 
decreasing oscillatory magnitude so that it can be distin- 
guished from the SP for as long as one second. 

Previous investigations of EP signals have been di- 
rected toward methods and devices for distinguishing 
between normal subjects and subjects with various 
brain dysfunctions and for use of EP signals to control 
hardware devices. 

Various regions of the brain have different functions 
and some of those regions are responsible for different 
types of conceptual functions, such as spatial relation- 
ship and word interpretation. When one of those areas 
of the brain dysfunctions, the specific mental functions 
associated therewith are impaired. 

U.S. Pat. No. 3,901,215 discloses selection of stimuli 
that are intended to generate different levels of brain 
function, such as sensory, perceptual, and conceptual 
function. A neurometric test battery is disclosed in the 
215 patent. That test battery includes several stimulus 
conditions that represent different levels of stimulus 
complexity. For each stimulus condition, the disclosed 
neurometric test battery attempts to determine whether 
the brain of a subject, as indicated by EP waveforms, 
distinguishes between two exemplars of a similar type. 
The model used in the ’215 patent assumes, however, 
only that a difference in EP signals received from the 
brain of a subject while that subject senses different 
stimuli indicates that the brain of the subject has distin- 
guished between those stimuli. Therefore, the only an- 
swer obtainable based upon the model disclosed in the 
*215 patent is that two stimulus conditions are either the 
same or different. 

U.S. Pat. No. 4,926,969 discloses an EP based control 
device in which a subject must focus attention on one 
checkerboard stimulus among a panel of such stimuli. 
Those stimuli are used to stimulate the receptor system 
of a subject at different frequencies. When the subject 
focuses attention on one of the panels, the unique fre- 
quency associated with that panel generates a unique 
EP waveform from the brain of the subject. The unique 
frequency dependence generated thereby is used to 
selectively control a hardware device. Different com- 
mands may be issued to the device depending upon 
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which checkerboard the subject stares at. Using that 
system, the subject must attend to a computer display 
representing a desired control command. The '969 pa- 
tent explicitly (see column 8, lines 34-41) avoids using 
complex stimuli such as size, color, and shape. 


SUMMARY OF THE INVENTION 


Accordingly, one object of this invention is to pro- 
vide a novel system that can be used to determine from 
brainwave recordings from a subject whether transla- 
tion of external stimuli has occurred. 

Another object of this invention is to provide a novel 
system for determining from the brain waves of a sub- 
ject whether conception, perception, or emotion has 
occurred in that subject. 

Another object of the invention is to provide a novel 


‘system for determining functionally damaged areas of 


the brain of a subject and to determine what type of 
functional damage has occurred. 

Another object of the invention is to provide a novel 
hardware control device that can be regulated by brain 
waveforms corresponding to predetermined thoughts. 

Another object of the invention is to provide a hard- 
ware control device than can be regulated by EP wave- 
forms induced by either external stimuli or by imagina- 
tion of a subject. 

These and other objects of the invention are provided 
by a novel system for the acquisition and decoding of 
EP and SP signals, which comprises a transducer for 
presenting stimuli to a subject, EEG sensors for record- 
ing brainwave signals from the subject, a computer for 
controlling and synchronizing stimuli presented to the 
subject and for concurrently recording brainwave sig- 
nals. The computer also provides means to decode the 
content of the brainwave signals according to a stimulus 
model for perceptual, conceptual, and emotional trans- 
lations. 

The invention also provide a novel SP source locator 
method for determining whether regions of the brain of 
a subject are functional or dysfunctional, by recording a 
plurality of SP waveforms from a plurality of scalp 
locations, determining three basis waveforms from the 
SP waveforms, along three orthogonal axes. Each of 
the basis waveforms provide a best fit to the variation in 
SP waveform along one of the orthogonal axes so that 
the most complete representation of all the SP wave- 
forms by linear combinations of the three basis wave- 
forms is provided. A coordinate for each SP waveform 
consisting of the three coefficients for the three basis 
waveforms representing that SP waveform is plotted, 
forming a three dimensional plot. That plot is compared 
with a similar plot representing normative values ob- 
tained from a large population of subjects, wherein 
deviations of the position of a coordinate corresponding 
to an electrode from a normative value position indi- 
cates that a functional region of the brain adjacent to 
said electrode position is dysfunctional. 

I have discovered that the brain interprets sensory 
stimuli to have perceptual conceptual or emotional 
meaning, that according to certain rules which indicate 
whether the stimuli have perceptual, conceptual, or 
emotional meaning, that EEG signals from the brain 
encode the type of interpretation of stimuli which the 
brain has made, and that similar EEG signals occur if an 
individual imagines an interpreted stimulus instead of 
experiencing that stimulus. Certain terms must be de- 
fined to adequately describe the discoveries and the 
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corresponding inventions. Those definitions along with 
a more detailed discussion of the discoveries and the 
inventions follow. 

I have discovered that the brain makes distinctions 
between stimuli based upon whether those stimuli have 
perceptual, conceptual, or emotional meaning to the 
brain, and that the brain does so based upon predeter- 
mined rules that the brain uses for interpreting real 
world stimuli external to the subject. External stimuli 
are defined to mean stimuli which are perceived via a 
sensory system of the body of the subject, as opposed to 
imagined stimuli. 

There is a hierarchy of brain interpretation. The brain 
attempts to interpret stimuli at the highest hierarchical 
level. Conceptual interpretation is higher in the hierar- 
chy than perceptual interpretation which is higher in 
the hierarchy than emotional interpretation which is 
higher in the hierarchy than the simple sensory informa- 
tion that impinges upon the subjects sensory receptors. 

I define use of the different rules used by the brain for 
interpreting stimuli as translations. The brain translates 
sensory input from external stimuli using the highest 
hierarchical interpretation in order to understand the 
real world. Translations are based upon stimulus attri- 
butes that a subject can understand and interpret. An 
attribute is defined to be a common feature that can be 
shared by more than one stimulus. An exemplar of an 
attribute is defined to be a particular example of that 
attribute. A stimulus set is defined to be a set of a stimuli 
which have a set of attributes with particular exemplars. 
An example of an attribute is color, and color has as 
exemplars red, green, blue, etc. Each stimulus exemplar 
may have more than one attribute associated with it. A 
stimulus set can be formed from stimuli that have selec- 
tive translations that are based upon conceptual, per- 
ceptual or emotional attributes. 

Conception is defined to mean that the interpretation 
of stimuli is based upon common symbolic and object 
attributes in a stimulus set. For instance, words and 
pictures are each symbol systems that can, for example, 
be used to represent objects such as cat and dog. The 
brain classifies information according to similarities and 
differences in the symbolic and object attributes repre- 
sented in the stimulus set. For example, each stimulus 
may use a word attribute and at the same time an object 
attribute. Alternatively, each stimulus may use a picture 
attribute and at the same time an object attribute. The 
brain concludes that the words and pictures for the 
same object are equivalent. At the same time the brain 
concludes that words belong to a common symbol sys- 
tem and that pictures belong to a common symbol sys- 
tem which is distinct from a word symbol system. 

Perception is defined to mean that the interpretation 
of stimuli is based upon common, nonsymbolic, pattern 
attributes in a stimulus set. The brain classifies informa- 
tion according to similarities and differences in the tex- 
ture and color attributes represented in a stimulus set. 
For example, each stimulus may use a texture attribute 
and at the same time a color attribute. The brain must be 
able to conclude that the color red is equivalent when 
associated with fine or coarse checkerboard stimuli, and 
at the same time the brain must be able to conclude that 
the color green is equivalent when associated with fine 
or course checkerboard stimuli in order to classify ac- 
cording to red or green. Similarly, the brain concludes 
that a coarse checkerboard texture is equivalent when 
associated with red or green stimuli, and at the same 
time the brain concludes that a fine checkerboard tex- 
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ture is equivalent when associated with red or green 
stimuli when classifying coarse and fine checkerboard 
texture. 

Emotion is defined to mean that the interpretation of 
stimuli is based upon common emotional and situational 
attributes in a stimulus set. The brain classifies informa- 
tion according to similarities and differences in the emo- 
tional and situational attributes represented in the stimu- 
lus set. Each stimulus may use a situational attribute and 
at the same time an emotional attribute. For example, 
the brain concludes that male and female faces that 
depict smiles can be interpreted as an equivalent happy 
emotion. Alternatively, the brain concludes that male 
and female faces that depict anger can be interpreted as 
an equivalent angry emotion. At the same, the brain 
concludes that male faces are equivalent when associ- 
ated with happy or angry emotions, and that female 
faces are equivalent when associated with happy or 
angry emotions. 

A. stimulus model is a model which represents attri- 
butes as orthogonal vector directions in a vector space 
and represents an exemplar of an attribute as a vector of 
a particular magnitude along the vector direction of its 
attribute. 


BRIEF DESCRIPTION OF THE DRAWINGS 


A. more complete appreciation of the invention and 
many of the attendant advantages thereof will be 
readily obtained as the same becomes better understood 
by reference to the following detailed description when 
considered in connection with the accompanying draw- 
ings, wherein: 

FIGS. 1 and 1A show a system for correlating brain- 
waves to the thoughts of a subject; 

FIG. 2 shows a system for providing NCP stimuli to 
a subject while recording EP signals from that subject; 

FIG. 3 shows three types of NCP systems for pres- 
enting auditory, visual, and tactile simulation, and also a 
system without a NCP; 

FIGS. 4A-4J show ten different stimulus sets that 
employ orthogonalized attributes; 

FIG. 5 shows mathematical relationships of a stimu- 
Ius model among orthogonalized stimulus attributes for 
the stimulus set of FIG. 4B; 

FIG. 6 shows EP waveforms recorded from a subject 
when that subject viewed the stimulus set shown in 
FIG. 4B; 

FIG. 7 shows a multi-channel recording of EEG (SP) 
data for a subject who is awake when the eyes of that 
subject are closed; and 

FIGS. 8A-8C show three SP structure diagrams 
representing a normative subject, a subject having tem- 
poral disconnection-closed head trauma and a subject 
with posterior interhemispheric disconnection-right 
Occipitoparietal tumor resection. 


DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 


Referring now to the drawings wherein like refer- 
ence numerals designate identical or corresponding 
parts throughout the several views and more particu- 
larly to FIG. 1 thereof which shows a novel system of 
the invention which includes CRT monitor 1 for pres- 
enting conceptual information to subject 2. CRT moni- 
tor 1 may be replaced by any transducer for sounds and 
touch. Microvoit level EEG signals of either the SP or 
EP type from subject 2 are measured with EEG elec- 
trodes 3 and amplified with an EEG amplifier 4. EEG 
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amplifier 4 is coupled to an analog-to-digital converter 
5 that transmits digitized versions of EEG signals to the 
central processing unit (CPU) 6. CPU 6 is coupled to 
random access memory (RAM) 7 and to hard disk 9 for 
storing and retrieving information. CPU 6 is also cou- 
pled to a non-contingent probe (NCP) transducer 8 for 
providing brief and meaningless background stimuli to 
subject 2. 

NCP stimuli are defined to be brief and meaningless 
stimuli that are identical to one another and applied to 
any of the sensory systems of a subject. NCP stimuli are 
used to generate EP waveforms. When no other stimuli 
are being presented to a subject, NCP stimuli evoke EP 
waveforms and the EP waveforms evoked by an NCP 
stimuli at one time are very similar to NCP evoked EP 
waveforms which are evoked at another time. 

Although FIG. 1 shows a single system for both 
presenting conceptual stimuli to subject 2 and for con- 
trolling device 10, it is clear to one of ordinary skill in 
the art that those functions may be provided in separate 
devices. 

FIG. 1A shows an alternative embodiment including 
a plurality of EEG recording electrodes 3 used to ob- 
tain simultaneous recordings of SP and/or EP signals 
from a plurality of locations on the head of subject 2. 

FIG. 2 shows a presently preferred embodiment for 
providing visual NCP stimuli to subject 2 and for re- 
cording EP waveforms from subject 2. FIG. 2 shows 
eyeglass frame 11 which includes annular rims 12 that 
contain NCP transducer 8. NCP transducer 8 may be an 
array of LCD's or an array of LED’s, as indicated by 
hashed areas on annular rim 12. In either case, NCP 
transducer 8 provides a brief background flash in order 
to evoke an EP waveform. That evoked EP waveform 
reflects the brain state of subject 2. Brain state is defined 
as the sum of EP waveform components including an 
EP waveform representing the background NCP stim- 
uli and an EP waveform component corresponding to 
the perceptual, conceptual or emotional translation of 
experience. Experiences are defined to mean either 
external stimuli received by subject 2 or stimuli imag- 
ined by subject 2. EP waveforms are recorded from 
electrodes 3 concurrent with the presentation of NCP 
stimuli. Electrical wires connecting NCP transducer 8 
and EEG electrodes 3 to the rest of the system are 
illustrated by dotted lines. 

FIG. 3 schematically shows that NCP transducer 8 
need not be limited to visual stimulation. NCP trans- 
ducer 8 may optionally stimulate any one or all of the 
sensory systems of subject 2. Visual, auditory, and tac- 
tile NCP stimuli may produce different EP waveforms 
and may produce different template waveforms from 
one another. However, in all cases shown in FIG. 3, the 
same algorithms may be used to record EP waveforms, 
to compare incoming EP waveforms with predeter- 
mined template waveforms, an to generate commands 
to activate an interface device. 

FIG. 3 also shows an autocorrelate mode in which no 
NCP stimuli are presented and only an SP waveform is 
recorded as a function of time. In that case, short time 
records of EEG signals are recorded with a recording 
frequency of between 1 and 10 Hz and analyzed to 
determine whether their waveforms correspond to the 
stimulus model discussed below. In an autocorrelate 
mode the stimulus model waveforms are SP waveforms. 

The system of the invention also includes a correlator 
with which to determine whether a series of raw EP 
waveforms from a subject are similar to a set of stored 
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EP waveforms, called template or TEP waveforms that 
correspond to waveforms generated by a predefined set 
of attributes. The correlator may comprise a program 
implemented via the CPU, and memory. Alternatively, 
the correlator may comprise a hardwired special pur- 
pose portion of CPU 6, an EPROM, or a similar hard- 
ware device. Predetermined TEP waveforms may be 
stored as data files on hard disk 9 or may be stored in a 
ROM. When a high correlation of an EP waveform 
received from the brain of a subject with one of the 
TEP waveforms stored in memory of the correlator 
exists, the system issues a command corresponding to 
the correlated TEP waveform. That command may be 
used to control a device to perform a specified function. 

TEP waveforms for subject 2 are determined prior to 
cybernetic control of device 10 by subject 2. TEP 
waveforms are determined in accordance with a stimu- 
lus model for a stimulus set. A different stimulus model 
is prepared for each stimulus set. The stimulus model 
represents the attributes of a stimulus set. The brain 
recordings are corresponded with a set of basis wave- 
forms which are sufficient in number to span the num- 
ber of attributes embodied in the stimulus set. 

The stimulus model along with a method for deter- 
mining what waveforms and magnitudes correspond to 
the basis waveforms and magnitudes for attributes and 
exemplars enable decoding of the content of the re- 
corded brainwave signals to indicate what translations 
have occurred in the brain. As discussed, that model 
represents attributes of the stimulus set as orthogonal 
waveforms which form a basis set of waveforms. Differ- 
ent amplitudes for an attribute represent different exem- 
plars of that attribute. That basis set of waveforms along 
with a background basis waveform of the model span 
the function space of EP waveforms for the stimulus 
set. 

A stimulus set is chosen to include stimulus exemplars 
so that every member of the set has at least two attri- 
butes in common with other members of the set. Prefer- 
ably, each set includes at least four stimuli and at least 
two attributes. A stimulus model for that stimulus set 
models each stimulus exemplar with orthogonal basis 
vectors having a sign and magnitude uniquely associ- 
ated with the attributes used in the set. Next, correspon- 
dence between the sign and magnitude of waveforms 
and exemplars is determined. 

A waveform corresponding to an attribute is defined 
to be an attribute waveform. A magnitude of an attri- 
bute waveform corresponding to an exemplar magni- 
tude is defined to be an exemplar magnitude of an attri- 
bute waveform. 

The stimulus model attribute waveforms and exem- 
plar magnitudes which correspond to the basis vectors 
of the stimulus model for subject 2 may be determined 
by presenting the stimuli of a stimulus set to subject 2 
while recording waveforms from the brain of subject 2, 
equating linear combinations of the attribute waveforms 
with exemplar magnitude coefficients corresponding to 
the model attributes and exemplars of each stimulus to 
the waveform recorded from the brain of subject 2 for 
that stimulus, and then solving for the attribute wave- 
forms and exemplar magnitudes using the linear equa- 
tions obtained for the stimuli. 

Once the attribute waveforms and exemplar magni- 
tudes for the exemplars of the model have been deter- 
mined they are stored in memory. With those predeter- 
mined stored values subject 2 may use the system de- 
Scribed with reference to FIG. 1 to control device 10. 
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However, it is useful to proceed with a training method 
for training subject 2 to improve his control of the sys- 
tem of FIG. 1. 

During training of subject 2 to control device 10, 
CPU 6 displays a conceptual stimulus (i.e., a stimulus 
which has symbolic meaning) on CRT monitor 1 and 
simultaneously delivers a continuous train of NCP stim- 
uli to subject 2. EP signals from subject 2 generated by 
attention of subject 2 to that stimulus while subject 2 is 
subjected to an NCP stimulus are recorded and com- 
pared with predetermined TEP waveforms. When a 
high correlation between the EP and TEP waveforms 
occurs subject 2 is notified e.g., via feedback from de- 
vice 10. In this training phase device 10 may be a device 
which produces an audible or visual signal in response 
to high correlation. After this training phase CRT 1 is 
extraneous and may be removed. 

When subject 2 controls device 10, device 10 is cou- 
pled through interface 10A to CPU 6. Device 10 is 
activated by commands from CPU 6 which are gener- 
ated in response to high correlations between NCP 
induced EP waveforms generated by subject 2 and 
predetermined stored template EP (TEP) waveforms 
stored in RAM 7 or on hard disk 8. 

In the presence of external stimuli or imagined stim- 
uli, EP waveforms evoked by a constant NCP stimuli 
may be represented by the linear superposition of or- 
thogonal basis waveforms of the stimulus model. A 
background basis waveform corresponds to the con- 
stant background NCP stimuli and the additional basis 
waveforms correspond to the attributes of the model. 
After an external stimulus or imagined stimuli an EP 
evoked by an NCP stimuli contains amplitude for basis 
waveforms corresponding to attributes of the external 
stimulus or imagined stimulus, so long as the NCP oc- 
curs while symbolic attributes provided by the external 
stimulus or thought remain in memory. 

In principle, a single NCP pulse may be applied and a 
single EP waveform recorded. The EP waveform is 
recorded during a short period subsequent to the NCP 
pulse and preferably within the first half second after 
the NCP pulse. Preferably, the NCP stimulus is re- 
peated with a frequency of between 1 and 10 Hz. EP 
signals are recorded synchronously with generation of 
NCP pulses in order to segment the time history of 
experiences of subject 2. 

The present invention also provides a novel diagnos- 
tic method for diagnosing brain dysfunction using the 
system disclosed above. The diagnostic method pres- 
ents diagnostic stimuli sets such as each of the stimuli 
sets shown in FIGS. 4A-4J in order to provide informa- 
tion regarding brain function. 

Each of FIGS. 4A-4J show a minimum stimulus set 
which is defined to be a set of four stimuli, each stimulus 
has associated with it two exemplars, each exemplar 
being an exemplar of one of two attributes. A stimulus 
model (i.e., mathematical representation) of a minimum 
stimulus set has two basis vectors which each represent 
one of the two attributes of the minimum stimulus set. 
An EP evoked from the brain of a subject while that 
subject views one of the stimuli of a minimum stimulus 
set is represented by a linear combination of two basis 
waveforms corresponding to the two attributes of the 
set, and also by a third background basis waveform. The 
third basis waveform is defined to be the background 
basis waveform of the EPs from that subject. The coef- 
ficients of the basis waveforms for the two attributes 
indicate the presence or absence of exemplars for those 
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attributes in the stimulus generating the EP. If the brain 
of a subject interprets and translates a stimulus set ac- 
cording to conceptual rules, then the EP waveforms for 
those stimuli may be represented by a linear combina- 
tion of two orthogonal basis waveforms, which corre- 
spond to translation and interpretation, i.e., attaching 
meaning to the stimuli, plus the background basis wave- 
form. 

The diagnostic method determines from EP wave- 
forms for subject 2 whether subject 2 translates percep- 
tual, conceptual or emotional stimuli according to a 
stimulus model, for each stimulus set. Reliable and re- 
peatable translations indicate that the brain of subject 2 
functions normally. 

FIG. 4A shows four stimulus exemplars which have 
as attributes check size and color. Small and large 
checkerboards having green and red colors occur in the 
four stimulus exemplars. 

FIG. 4B shows four stimulus exemplars which have 
as attributes form and color. Circles and triangles hav- 
ing green and red colors occur in the four stimulus 
exemplars. i 

FIG. 4C shows four phoneme stimulus exemplars 
which have as attributes the initial consonants B and P 
and the ending vowels A and U. Initial consonants B 
and P having ending vowels A and U occur in the four 
stimulus exemplars. 

FIG. 4D shows four phoneme stimulus exemplars 
which have as attributes the initial consonants K an T 
and the ending vowels A and U. Initial consonants K 
and T having ending vowels A and U occur in the four 
stimulus exemplars. 

FIG. 4E shows four stimulus exemplars which have 
as attributes words and pictures of objects. Words and 
pictures of CAT and RAT occur in the four stimulus 
exemplars. 

FIG. 4F shows four stimulus exemplars which have 
as attributes words and pictures of objects. Words and 
pictures of BAT and HAT occur in the four stimulus 
exemplars. 

FIG. 4G shows four stimulus exemplars which have 
as attributes words and pictures for the actions READ(- 
ing) and WRITE(ing). The words for and pictures of a 
human in the act of READ(ing) and WRITE(ing) occur 
in the four stimulus exemplars. 

FIG. 4H shows four stimulus exemplars which have 
as attributes words and pictures for the actions FEED(- 
ing) and FIGHT(ing). The words for and pictures of a 
human in the acts of FEED(ing) and FIGHT(ing) 
occur in the four stimulus exemplars. 

FIG. 4I shows four stimulus exemplars which have as 
attributes words and pictures for the spatial orientations 
LEFT and RIGHT. The words for and pictures of 
arrows that indicate the spatial orientations LEFT and 
RIGHT occur in the four stimulus exemplars. 

FIG. 4J shows four stimulus exemplars which have as 
attributes words and pictures for the spatial orientations 
ABOVE and BELOW. The words for and pictures of 
arrows that indicate the spatial orientations ABOVE 
and BELOW occur in the four stimulus exemplars. 

Each set of stimuli shown in each of FIGS. 4A-4J are 
used in a neuropsychometric test battery designed to 
determine whether the brain of subject 2 can translate 
the types of similarities and differences among the attri- 
butes embodied in the stimulus exemplars in each set. It 
is clear to one of ordinary skill that the neuropsychom- 
etric test battery extends to other sensory and motor 
systems. Emotions such anger, joy, sadness, happiness, 
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depression, elation, and fear are all attributes that can be 
conveyed by stimuli and therefore categories of transla- 
tions corresponding to emotive symbolism may also 
appear in the stimulus model of the present invention. It 
is also clear to one of ordinary skill that categories of 
translations can be established for cross-modal functions 
that entail more than one sensory or motor system. For 
example, visual and auditory sensory input may be used 
to provide meaningful signals for translation. 

The neuropsychometric test battery comprises an 
algorithm for presenting various stimuli sets, such as the 
stimuli sets shown in FIGS. 4A-4J, to a subject in order 
to determine what types of translations that subject is 
capable of. A presently preferred embodiment for algo- 
rithms of the neuropsychometric test battery will be 
described with reference to FIG. 1 and with reference 
to the computer program listing in Appendix A at the 
end of this specification. The preferred test battery 
algorithm includes an EP acquisition routine and an EP 
analysis routine, such as routines IV.A.2 and IV.A.3 
listed in Appendix A. 

The EP acquisition routine first initializes system 
variables NSTIM=4 (number of stimuli in set), 
NREP —80 (number of times each of the NSTIM stim- 
uli is to be presented), and Ἐ 5ΤΕ--0 (pointer to 
NSTIM arrays that contain the graphic image for each 
stimulus). Next, the subroutine LOAD. R reads from 
disk and loads NSTIM graphic images into RAM so 
that the images can be displayed on CRT 1. Next, the 
first of the NSTIM stimuli is flashed on CRT 1, and at 
the same time, A/D converter 5 begins sampling from 
the EEG amplifiers. The flashed stimuli generates an 
EP in the brain of subject 2. A/D converter 5 repeat- 
edly samples the EEG amplifier outputs for up to one 
second to construct an EP waveform. The EP is re- 
corded by subroutine READ. EP and it is then saved 
by routine SAVE. EP. Then, NREP is decremented by 
one. The steps above are repeated until NREP=0. 
Then NSTIM is decremented by one and R_STP is 
incremented to point to the second stimulus image in 
the set. The routine then loops through NREP sequen- 
ces for the second stimulus, and continues to decrement 
NSTIM, and increment R_STP, until NSTIM —0 and 
80 EP waveforms have been saved for each of the four 
stimuli. The routine then automatically terminates ac- 
quisition. The same procedures are automatically ap- 
plied to EP waveform data from all recording elec- 
trodes 3. The acquisition routine can then be repeated 
for all remaining stimulus sets of the neuropsychometric 
battery. In Principal Components Analysis the back- 
ground basis waveform is defined as the principal com- 
ponent and the remaining basis waveforms are defined 
as unique components. The background waveform, or 
principal component, must be substracted from each of 
the four EP waveforms to obtain the unique EP wave- 
forms that correspond to the desired perceptual, con- 
ceptual and emotional translations that have occurred 
due to the stimuli. 

The saved EP data are analyzed in the EP analysis 
routine, which proceeds as follows. The system vari- 
ables are initialized, NSTIM=4 and NREP=80. The 
analysis routine then reads NREP EP waveforms for 
the first stimulus from hard disk, and accumulates a sum 
of the first set of EP waveforms in RAM. The analysis 
routine then loops to decrement NSTIM, reads NREP 
EP waveforms for each of the remaining stimuli from 
hard disk and accumulates summed EP waveforms for 
each stimulus in RAM. When NSTIM=0, the routine 
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10 
has completed four summed EP waveforms for each of 
the NSTIM stimuli. Each summed EP waveform is then 
normalized by dividing by NREP to construct an aver- 
aged EP waveform for each stimulus. These calcula- 
tions are automatically applied to EP waveform data 
from all recording electrodes 3. 

The STRUCTURE routing is used to construct 
ΕΡ. Structures for each recording electrode. The four 
averaged EP waveforms represent the brain’s response 
to a stimulus set. The four EPs are modelled by a mathe- 
matical representation in which a perceptual or concep- 
tual attribute in a stimulus set evokes a basis waveform. 
The presence of a second independent attribute evokes 
a second basis waveform. In the most general sense, the 
EP waveform can be defined as the linear superposition 
of k orthogonal basis waveforms which are sufficient in 
number to represent k attributes. Orthogonal means that 
the squared correlation coefficient between each pair of 
k basis waveforms, r2, is <9%. 

All the stimulus sets in the neuropsychometric test 
battery use stimuli which each have two attributes. For 
each attribute there are two exemplars. For example, in 
FIG. 4B, there are form and color attributes. Each 
attribute is modelled in the stimulus model by an or- 
thogonal basis waveform. Each orthogonal basis wave- 
form has a contribution of equivalent magnitude so that 
the equal weighted sum of the two basis waveforms 
provides a waveform which is identical to the original 
EP waveform. 

For any stimuli, there is a background basis wave- 
form which corresponds to the reaction of the brain to 
energy fluctuations presented by that stimulus. That 
background basis waveform is the same shape for each 
stimulus in a stimulus set and does not contain any infor- 
mation regarding attributes of the stimuli or translations 
performed by the brain. That background basis wave- 
form is the arithmetic average of the four EP wave- 
forms generated for a stimulus set of the neuropsychom- 
etric test battery. In Principal Components Analysis the 
background basis waveform is defined as the principal 
component and the remaining basis waveforms are de- 
fined as unique components. The background wave- 
form, or principal component must be subtracted from 
each of the four EP waveforms to obtain the unique EP 
waveforms that correspond to the desired perceptual, 
conceptual or emotional translations that have occured 
due to the stimuli. 

FIG. 5 shows, in tabular form, a mathematical model 
for the stimulus set shown in FIG. 4B. That model 
applies to all the 2X2 stimulus sets shown in FIGS. 
4A-4J. FIG. 5 shows that EP waveforms for each of 
the objects having shape and color attributes in FIG. 4B 
is modelled as a linear combination of shape and color 
basis vectors. 

For any pair of stimulus exemplars that have the same 
attribute the EP waveform generated by those stimuli 
have the same basis waveform that are equal in magni- 
tude and have the same sign. However, any pair of 
stimulus exemplars that represent opposing attributes in 
the neuropsychometric test battery have the same basis 
waveform that are equal in magnitude and opposite in 
sign. 

All the 2X2 orthogonal stimulus sets of the neurop- 
sychometric test battery may be modelled in a stimulus 
model having two orthogonal basis waveforms corre- 
sponding to two attributes and two coefficients with 
opposing signs, with each attribute represented by two 
exemplars for that attribute. 
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The four EP waveforms generated by the four stimuli 
of a stimuli set of the neurocybernetic battery may be 
graphically represented on the circumference of a unit 
circle by means of the coefficients for each of the basis 
waveforms corresponding to each of the four stimuli. 

FIG. 6 graphically illustrates an analysis of EP wave- 
forms generated in response to the stimuli shown in 
FIG. 4B. The left-hand column of FIG. 6 shows the 
original EP waveforms and basis waveforms indicated 
by columns labeled component 1, component 2, and 
component 3. Also shown in the right-hand column are 
the residual magnitudes of the EP waveforms which 
cannot be represented by a linear combination of the 
first, second, and third basis waveforms. The numbers 
adjacent to each of the waveforms shown in the second 
through fifth columns indicate the coefficients for each 
of those waveforms necessary to most accurately repre- 
sent the original EP waveforms shown in the left-hand 
column. As can be seen in FIG. 6, the waveform shown 
in the column labeled component 1, which does not 
correspond to translation, is almost identical for all 
stimuli of the stimuli set. The preferred embodiment 
routinely removes an average background EP wave- 
form corresponding to the average value for all the 
waveforms shown in the column labeled component 1, 
prior to analyzing EP waveforms for translations. 

The neuropsychometric test battery determines 
whether the brain of a subject 2 can perform transla- 
tions corresponding to recognition of the attributes 
existing in a particular stimuli set. More than two attri- 
butes may exist in a particular stimulus set in which case 
more than two basis waveforms corresponding to those 
attributes exist and are included in the model of the 
stimulus set. 


3 
Different individuals have different EP waveforms 


for the same stimuli. Therefore, the unique EP wave- 
forms of a subject must be determined for that subject. 

When subject 2 imagines a stimulus (i.e., that is when 
no external stimulus is presented but the subject imag- 
ines such a stimulus) while an NCP stimulus is presented 
the generated EP waveform includes a basis waveform 
corresponding to the imagined stimulus. Furthermore, 
the basis waveform so generated is the same basis wave- 
form that occurs when subject 2 views on CRT monitor 
1 the same stimulus which was imagined. In other 
words, when subject 2 perceives, conceives or emotes, 
either due to external stimuli or due to imagined stimuli, 
the same basis waveforms are produced. 
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training an individual to use NCP stimuli in conjunction 
with the imagination of subject 2 in order to control a 
neurocybernetic device. That training method trains 
subject 2 to improve correlation between translations 
that occur due to imagined stimuli and due to external 
stimuli. The training method for NCP includes provid- 
ing biofeedback indicative of the level of correlation 
obtained between an EP generated due to imagination 
for a particular stimuli and the corresponding stored 
template EP which had been stored in response to a 
previous presentation of that external stimuli to subject 
2. However, the training proceeds in two phases. 
First, subject 2 is trained to improve correlation be- 
tween EP waveforms generated in response to an exter- 
nal stimuli and previously recorded responses to the 
same external stimuli. Next, subject 2 is trained to in- 
crease the correlation between EP waveforms gener- 
ated in response to imagination of a stimuli and stored 
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TEP waveform stored in response to the viewing by 
subject 2 of the corresponding external stimuli. 

The present invention also provides a novel diagnos- 
tic feedback method for improving reliability of transla- 
tion which have been indicated to be unreliable by the 
diagnostic method. 

For the diagnostic feedback method, hardware de- 
vice 10 comprises a feedback device which, for in- 
stance, generates an audible beep or a visual flash to 
inform subject 2 when high correlations occur between 
corresponding EP waveform and a TEP waveform for 
a stimulus of a stimulus set which subject 2 does not 
reliably translate. The diagnostic feedback method pro- 
vides a neurocognitive rehabilitation method to train 
subject 2 to improve translations of perceptual, concep- 
tual and emotional stimuli. 

Neurocognitive rehabilitation allows subject 2 to 
provide higher correlations between a stored template 
waveform indicative of translation of a stimulus and EP 
waveforms generated by subject 2 in response to being 
stimulated by that stimulus. Since higher correlation 
between stimulus EP waveforms and prerecorded tem- 
plate waveforms improves the reliability of control of 
external hardware device 10, the rehabilitative process 
discussed above improves the utility of a neurocyber- 
netic device of the present invention. 

By using feedback, the subject may increase the cor- 
relation between EP waveforms and predetermined 
TEP waveforms in order to provide higher reliability in 
issuing of commands so that those commands are only 
issued when corresponding perceptual, conceptual or 
emotional translations occur and those commands are 
not issued when corresponding perceptual, conceptual 
or emotive translations do not occur. The correlation 


5 between the EP and TEP waveforms may be defined 


by, for instance, by the Pearson product-moment corre- 
lation coefficient. The absolute correlation value re- 
quired to issue a command to device 10 may be set to a 
level providing high reliability. 

The invention also provides a novel SP source loca- 
tor method for identifying regions of the brain responsi- 
ble for EP waveform translations and determining 
when those regions are dysfunctional. SP waveforms 
are recorded from a plurality of scalp electrodes dis- 
posed at various positions about the head of a subject. A 
set of such SP waveforms is shown in FIG. 7. 

FIG. 7 shows 2.5 second recordings of EEG SP 
waveforms obtained from electrodes 3. Nineteen of 
electrodes 3 were attached to various regions of the 
head of subject 2. Also shown is a concurrent recording 
of the electro-occulogram (EO), which was used to 
identify eye movement artifacts. Labels on the left-hand 
side of the SP waveforms correspond to the positions on 
the head of subject 2 of each electrode 3 from which 
those waveforms were obtained. Odd numbered labels 
indicate that the corresponding electrode was at the left 
hemisphere and even numbered labels indicate that the 
corresponding electrode was at the right hemisphere. 
Labels having a “z” suffix indicate electrodes are lo- 
cated on the center of the midsagittal plane which ex- 
actly divides the left and right hemispheres of the brain. 
Labels that have a “fP”? prefix correspond to electrodes 
positioned on the scalp at regions adjacent to prefrontal, 
frontal, and premotor regions of the brain. Labels that 
have a “t” prefix correspond to electrodes positioned on 
the scalp adjacent to anterior-posterior temporal lobes 
of the brain. Labels that have a “ο” prefix correspond to 
electrodes positioned on the scalp adjacent to sensory 
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motor regions of the brain. Labels that have a “o” or 
*p" prefix correspond to electrodes positioned on the 
scalp at regions adjacent to the occipital and parietal 
regions of the brain, respectively. ' 

The data shown in FIG. 7 was recorded while the 
eyes of subject 2 were closed and while subject 2 was 
relaxed and while no stimuli was being presented to 
subject 2. FIG. 7 shows SP waveforms and those wave- 
forms have correlations (i.e., the waveforms are similar 
to one another). 

Each of those SP waveforms is modelled as a linear 
superposition of three basis waveforms whose coeffici- 
ents are the coordinate positions of the modelled SP 
waveforms. Preferably, a background corresponding to 
eye movement artifacts is initially subtracted from the 
SP waveforms. Mathematically, the three basis wave- 
forms ΕΙ, f2, and f3 are equated to each of the SP wave- 
forms, SP(xiyizij) for i=1 to the number of SP wave- 
forms, N, recorded by electrodes at coordinates 
(X5 yaZi), as: 


SP(xsyiz m xifi -yifa--zifs- K 


where K is a constant function. The N linear equations 
of the model are used to provide the best solutions for 
the gradient waveform functions fi, fo, and f; (i.e., the 
solutions which provide the smallest errors between the 
SP waveforms and the linear combination of basis 
waveforms). The SP waveforms are then each repre- 
sented by a linear combination of the basis waveform 
functions and coefficients for the representation which 
provide the closest approximation for each of the SP 
waveforms are determined. The determined coefficients 
for each of the electrode positions for the subject are 
compared with normative values of determined coeffi- 
cients for the same electrode position determined from 
a large population of subjects. Large deviations from 
the normative determined coefficient values indicate a 
brain abnormality in the brain region of the subject 
which is adjacent to that electrode position. 

Conventionally, axes extending from the left side of 
the head to the right side of the head, from the back of 
the head to the front of the head, and from the ventral 
to the dorsal positions of the head are represented by x, 
y, and z axes, respectively. The determined coefficients 
may be plotted in a three dimensional plot or in a 2 
dimensional projection along a plane, with the deter- 
mined coordinates plotted along the axes to which they 
correspond. We call those plots SP source locator plots. 

A pattern exists in the SP source locator plot in 
which the relative positions of electrode plot position 
correspond roughly to relative positions of electrodes 
on the head of the subject. Furthermore, the relative 
position of points in the source locator plot are very 
similar for all subjects with normally functioning brains. 

When positions of points in the three-dimensional 
space representing electrode positions on the head of a 
subject do not correspond to normative values (from a 
large population of subjects) of those positions, brain 
dysfunction in the region near the non-correlated elec- 
trodes is indicated. 

Failure in brain function can be attributed to prior 
insults and trauma that resulted in disconnection syn- 
drome such as when a portion of the brain is torn free 
from surrounding structures leaving that region of the 
brain to function independently without integration to 
the rest of the brain. When a brain region is isolated by 
injury and no longer connected to the remaining func- 
tions of the brain, that regions generates unique SP 
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waveforms that primarily arise from the injured tissues. 
The source locator identifies those disconnected re- 
gions as statistical deviations from an expected distribu- 
tion of critical functions within the x, y, and z SP gradi- 
ent coordinate space. The source locator method pro- 
vides information about pathological reasons for the 
failure of a subject to generate EP waveforms for par- 
ticular perceptual, conceptual and emotional stimuli. 

Expected distributions of determined coordinates in a 
source locator plot are based upon the means and stan- 
dard deviations of sets of coefficients obtained from a 
normal population of human subjects. The determined 
coordinates for electrodes from individuals with brain 
dysfunction are compared to normative source locator 
plot data from normal subjects, by computing the statis- 
tical distance, ie., variation in coordinates in source 
locator plot between source locator points for an indi- 
vidual and normative coordinates for a large popula- 
tion. 

A deviation of a determined position for an individual 
from a normative value indicates that a region of the 
brain that is adjacent to the electrode for that source 
locator point is dysfunctional. Since functions of a dys- 
functional region cannot properly be performed, EP 
signals which would result from translations performed 
in that portion of the brain may not occur. Since the 
stimulus model discussed above is only accurate when 
the brain performs translations corresponding to the 
model, it is useful to know which portions of the brain 
are dysfunctional in order to adjust the stimulus model. 

FIG. 8A shows an average SP structure for represen- 
tative recordings from 25 normal subjects with 2 re- 
cordings from each subject in which the SP waveforms 
for all electrodes 3 are represented by coefficients that 
locate their functional origin within the brain. Those 
coordinates comprise the normative SP structure for 
brains from normal populations. Those coordinates also 
closely approximate the relative positions of EEG elec- 
trodes 3 on the scalp of subject 2 during recording. 

FIG. 8B shows an SP structure for a subject who had 
closed head trauma due to an automobile accident. FIG. 
8B shows that the SP waveforms of electrodes F7 and 
T3 have low correlations with the three basis wave- 
forms, and are extruded or disconnected from the over- 
all SP structure. 

FIG. 8C shows an SP structure for a subject who had 
surgical resection of the right occipitoparietal area be- 
cause of a tumor in that region. FIG. 8C shows that the 
SP waveforms for all electrodes in the right posterior 
lobe have low correlations with the three basis wave- 
forms, and are disconnected from the overall SP struc- 
ture. 

At the present time, there are no other brain measure- 
ments that describe disconnection syndrome in the man- 
ner shown in FIGS. 8B and 8C. These measurements 
provide a significant key with which to determine why 
subject 2 cannot perform specific mental functions such 
as perception, conception, thinking and feeling. The 
presence of disconnected brain regions precludes train- 
ing and the control of device interfaces by means of 
conception, conceptual thought or feeling. Such discon- 
nection requires rehabilitation before neural control of a 
device interface is possible. The reconnection proce- 
dure described below provides a means for improving 
the connectivity between disconnected or dysfunctional 
regions of the brain and the remaining regions of the 
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brain. Once reconnection has been effected, subject 2 
may be trained to control a hardware device. 

The present invention provides a novel method for 
using feedback in conjunction with the SP source loca- 
tor method to train brain injured patients to rehabilitate 
dysfunctional mental functions. Similar to the technique 
called **neuro-muscular rehabilitation", the source loca- 
: tor feedback method coupled with feedback from con- 
trolled device 10 of the present invention allows brain 
injured patients to use feedback signals to indicate when 
connectivity between specific brain regions is high. 
That procedure allows the subject to discover and use 
mental strategies that yield high rates of feedback. 

First, the SP source locator method is performed. 
Then, feedback corresponding to the correlation be- 
tween source locator points and normative population 
points is presented to the subject. The SP source locator 
method is again performed and the results fed back to 
the subject via, for example, device 10. By trial and 
error, the subject uses that feedback to reduce the devi- 
ation between his or her individual source locator 
points and normative positions for those points. 

When a dysfunctional region of the brain of a subject 
is so rehabilitated, it is not necessary to modify the 
stimulus model prior to performing EP evaluations for 
use of that model with a neurocybernetic control de- 
vice. 

The linear equations for basis vectors do not usually 
have an exact equality to the EP and SP waveforms, in 
the models discussed above. This is so because the data 
is real data with real variations from any model. There- 
fore solutions for the attribute waveforms, exemplar 
coefficients, SP source locator basis waveforms and SP 
source locator determined coefficients must take into 
account the inexact correspondence between the model 
and the data. The inexact nature of the correspondence 
is accounted for by finding a "best fit" between the 
model parameters mentioned above and the data. A best 
fit maximizes correlation or equivalently minimizes 
deviations between the modelled values of the SP and 
EP waveforms and the actual recorded values for them. 
One way to minimize deviations is to use a least squares 
analysis to minimize the sum of the squared differences 
between model values for waveforms and the recorded 
waveforms. 

Correlation maximization may also be used to pro- 
vide a best fit. Pearson product-moment correlations 
are used with both raw unfiltered, and with filtered SP 
waveforms. Filtered waveforms are raw SP waveforms 
decomposed into four well known frequently bands: the 
ὃ band from 3.5 to 7 Hz, the 0 band from 3.5 to 7 Hz, the 
a band from 7 to 13 Hz and the β band from 13 to 30 
Hz. The method yields a triangular matrix of correla- 
tion coefficients that describe the relative similarities 
and dissimilarities in raw or filtered SP waveforms for 
all combinations of electrode positions. 

The five triangular matrices (four frequency bands 
plus the original data set) may be analyzed to provide 
source locator plot data. Each matrix is decomposed 
and modeled as a linear combination of three orthogo- 
nal basis waveforms. 'The three orthogonal basis wave- 
forms represent three anatomical directions (anterior- 
posterior, dorsal-ventral, and lateral directions) and 
along with the determined coefficients are determined 
as discussed above. 

The present invention provides a determination of 
basis waveforms and coefficient for anatomical/func- 
tional family membership of SP waveforms from a plu- 
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rality of scalp locations and also perceptual or concep- 
tual family membership of EP waveforms from a plural- 
ity of perceptual conceptual or emotional attributes of 
stimuli. Both of those types of determination require 
solution of a set of linear equations which are equated to 
real data and are therefore, strictly speaking, not equa- 
tions but correlations or best fits to the data, and types 
of determinations use identical algorithms for their solu- 
tion. Those types of equations may be solved using 
methods generally called factor analysis and preferably 
the specific factor analysis methods called principal 
components analysis (PCA) which are well known. A 
complete discussion of factor analysis including its the- 
ory and implementation, including FORTRAN pro- 
gram listings can be found in “Introduction to Modern 
Factor Analysis" (Guertin and Bailey, 1970, Edward 
Brothers Inc., Ann Arbor, Mich.), and in particular the 
PRINCO PCA program on pp. 116-118, the discussion 
of PCA on pp. 30-33 and 96-102, and in *Multivariant 
Data Analysis" (1971, Wiley & Sons Inc., New York, 
N.Y.), which also describes PCA. Those books are 
incorporated herein by reference. The PRINCO PCA 
program has been included at the end of this specifica- 
tion in Appendix II, for convenience. 

Assuming we want to describe waveforms, the defini- 
tions for N, M, & L of the PRINCO routine are: 

N=number of EP or SP waveforms (R=correlation 

matrix and is NXN; LI=0 for full rank); and 

M number of digitized points in an EP/SP wave- 

form record. 

L number of basis waveforms to return. 

The PCA method is used in the same way for both SP 
and EP waveforms, the only distinction being that pre- 
ferred SP waveforms are long records of greater than 1 
minute duration and are recorded from a plurality of 
scalp positions, while preferred EP waveforms are 
short records of between 0.5 and 1 second in duration. 
For both SP and EP data of the present invention PCA 
provides a “best fit" to the data. 

A description of PCA in the context of the present 
invention is presented below. Let W; equal the number 
of waveforms which represents the number of elec- 
trodes in an SP analysis and which represents the num- 
ber of stimuli in an EP analysis. 

W; for i=1,..., N, represents a set of N waveforms. 
The N waveforms are stored in a computer. A correla- 
tion matrix, such as a Pearson matrix, is formed by 
correlating each of the N waveforms with every other 
one of the N waveforms. 

The correlation matrix is factored using a standard 
PCA computer program to obtain k orthogonal basis 
waveforms C; or 151, . . . , k, that are sufficient to 
represent at least 85% of the variability in correlations 
among all the electrode waveforms according to equa- 
tions 3 and 4. Each of the N waveforms has a correla- 
tion with each of the k basis waveforms. The correla- 
tion coefficient between a basis waveform and one of 
the N waveforms stored in memory defines the contri- 
bution of that basis waveform to the waveforms stored 
in memory and, for the ith waveform stored in memory 
and the jth basis waveform is defined to be aj. Thus, if 
aj is the contribution from the component C; (ie., 
where Cjis the first basis waveform), and aj is the con- 
tribution for the component C» (ie., where C2 is the 
second basis waveform), then: 


Letters Patent of the United States is: 


5,392,788 


17 
Wy = aj1C1 + α1202 + 21303 . . . a1kCk Ea 2) 
W2 = a21C1 + a22C2 + a23C3 . . . a2kCk 
5 


Wy = ανιΟΙ + apC + an3C3... aNkCk 

In the case of N SP waveforms for N electrodes, 19 
k=3, which is the number of anatomical directions (the 
anterior-posterior direction, the lateral direction, and 
the dorsal-ventral direction). In the case of N EP wave- 
forms for an N-stimulus set, k equals the number of 
attributes which is one less than the dimensionality of 
the basis set due to the background basis vector. 

FIGS. 8A-8C show results of an SP analysis using 
multichannel recordings of SP waveforms to compute 


15 


SP structures for a normal brain, for a brain with left 


fronto-temporal damage, and for a brain with right 20 


posterior disconnection, respectively. Each of FIGS. 


8A-8C presents two-dimensional projections onto stan- 


dard neuroanatomical planes: the horizontal plane com- 
prising the anterior-posterior and lateral directions; the 
sagittal plane along the anterior-posterior and dorsal- 
ventral directions and the coronal plane along the dor- 


25 


sal-ventral and lateral directions. 


Obviously, numerous modifications and variations of 
the present invention are possible in light of the above 
teachings. It is therefore to be understood that, within 
the scope of the appended claims, the invention may be 
practiced otherwise than as specifically described 


30 


herein. 


What is claimed as new and desired to be secured by 3i 

1. A system for acquiring EEG waveforms from a 

subject and interpreting those waveforms to indicate 

what the subject is experiencing or thinking, compris- 

ing: 

means for recording brainwave EEG waveforms 
from the subject; 

means, coupled to said means for recording, for rep- 
resenting a brainwave EEG waveform that has 
been recorded by the means for recording as a 
linear combination of a set of basis waveforms, said 45 
linear combination consisting of a weighted sum of 
all members of the set of basis waveforms in which 
each member of the set of basis waveforms is 
weighted by a weighting coefficient; 

means, coupled to said means for representing, for 
corresponding thought attributes to members of 
the set of basis waveforms, a first thought attribute 
corresponding to a first basis waveform of the set 
of basis waveforms; 

means, coupled to said means for representing, for 
corresponding each member of a set of thought 
exemplars for the first thought attribute to a differ- 
ent thought exemplar range of weighting coeffici- 
ent values for the first basis waveform than any 
other member of the set of thought exemplars, a 
first thought exemplar range of weighting coeffici- 
ents corresponding to a first thought exemplar of 
the first basis waveform for the first thought attri- 
bute; 

means, coupled to said means for representing, said 
means for corresponding thought attributes, and 
said means for corresponding each member of a set, 
for determining when the first thought exemplar 
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18 
range includes a weighting coefficient of said linear 
combination for the first basis waveform; 

means, coupled to said means for determining, for 
generating a thought signal indicating when said 
weighting coefficient is in the first thought exem- 
plar range; 

a device for performing a specified function in re- 
sponse to a thought by the subject; 

a controller interface, coupled to said means for gen- 
erating and to the device, for converting said 
thought signal into a control signal for controlling 
the functioning of the device. 

2. A system according to claim 1, further comprising: 

means, coupled to the means for recording, for pres- 
enting stimuli of the stimulus model to said subject. 

3. A system according to claim 1, further comprising: 

means, coupled to the means for recording, for repeti- 
tively presenting a brief first stimuli to the subject; 

means, coupled to the means for recording and the 
means for repetitively presenting, for controlling 
presentation of the first stimuli to the subject; and 
means, coupled to the means for recording and the 
means for repetitively presenting, for synchroniz- 
ing presentation of the first stimuli with recording 
of brainwave EEG waveforms that comprise EP 
type signals. 

4. A system according to claim 1, wherein: 

said means for recording comprises an EEG elec- 
trode, an analog to digital converter coupled to the 
EEG electrode, said analog to digital converter 
functioning by converting a signal provided by the 
EEG electrode into digital form, a digital CPU 
coupled to the analog to digital converter, and 
memory means coupled to the digital CPU. 

5. A system according to claim 4, wherein said means 
for corresponding each member of a set of thought 
exemplars further comprises: 

means for determining correlation values between 
said brainwave EEG waveform and members of 
the set of basis waveforms. 

6. A system according to claim 4, further comprising 
an eyeglass frame on which is mounted said means for 
repetitively presenting. 

7. A system according to claim 1, wherein said means 
for recording comprises EEG electrodes that are con- 
nected to an EEG amplifier, an analog to digital con- 
verter having an input that is connected to an output of 
EEG amplifier, and a memory medium that is coupled 
to said analog to digital converter for storing digital 
signals provided by the analog to digital converter. 

8. A system according to claim 7, further comprising 
a central processing unit that is coupled to said analog 
to digital converter and to said memory medium. 

:9. A system according to claim 8, wherein said means 
for generating a thought signal comprises an interface 
that is connected to said central processing unit. 

10. A system according to claim 9, further compris- 
ing: 

means, coupled to the means for recording, for repeti- 
tively presenting a brief first stimuli to the subject, 
said means for repetitively presenting comprising a 
transducer; 

wherein said means for repetitively presenting is cou- 
pled to and controlled by said central processing 
unit. 
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11. A system according to claim 10, further compris- 
ing an eyeglass frame on which is mounted said means 
for repetitively presenting. 

12. A system according to claim 1, wherein said 
means for recording comprises EEG electrodes that are 
connected to an EEG amplifier, an analog to digital 
converter having an input that is connected to an output 
of said analog to digital converter, and a memory me- 
dium, and further comprising: 

a central processing unit that is connected to said 

analog to digital converter; 

a display monitor that is connected to and controlled 

by said central processing unit; and 

means, coupled to the central processing unit, for 

displaying indicia of the thought exemplars of the 
thought attributes that correspond to members of 
the set of basis waveforms. 

13. A method for acquiring and decoding EEG 
waveforms from a subject to determine what the sub- 
ject is thinking, comprising: 

recording brainwave EEG waveforms from the sub- 

ject; 

providing a stimulus model representing attributes of 

stimuli as basis vectors of a vector space and repre- 
senting exemplars of each attribute as magnitudes 
for the corresponding basis vectors; 

interpreting said EEG waveforms according to a 

stimulus model in terms of the attributes and the 
exemplars of the model to determine waveforms 
corresponding to the attributes and the exemplars. 

14. A method for determining attribute waveforms 
and exemplar coefficients for stimuli of a stimulus set for 
a subject, comprising the steps of: 

modelling the attributes as basis vectors of a vector 

space and modelling exemplars of an attribute as 
coefficients for that attribute; 

presenting stimuli of the stimulus set to the subject; 

recording EEG signals from the subject during the 
step of presenting stimuli of the stimulus set to the 
subject, thereby providing recorded EEG signals 
from the subject; 

corresponding each of the recorded EEG signals, to 

a linear combination of the basis vectors whose 
coefficients represent exemplars associated with 
the first stimuli; 

determining coefficients and basis vectors represent- 

ing exemplars and attributes, respectively, which 
provide a best fit to the recorded EEG signals. 

15. A method according to claim 14, wherein the step 
of determining coefficients and basis vectors represent- 
ing exemplars and attributes, respectively, which pro- 
vide a best fit to the recorded EEG signals comprises 
the step of performing principle components analysis 
upon the linear combinations of basis vectors and re- 
corded EEG signals from the subject. 

16. A system for acquiring EEG waveforms from a 
subject and interpreting those waveforms to indicate 
what the subject is thinking, comprising: 

first means for recording brainwave EEG waveforms 

that comprise EP type EEG signals from the sub- 
ject, comprising an EEG electrode; 

second means for repetitively presenting a brief first 

stimuli to the subject; 

third means, coupled to the first means and to the 

second means, for controlling presentation of the 
first stimuli to the subject; 
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fifth means for synchronizing presentation of the first 
stimuli with recording of said brainwave EEG 
waveforms by the first means; and 

sixth means, coupled to the third means, for present- 
ing second stimuli to said subject during presenta- 
tion of the first stimuli to the subject by the third 
means. 

17. A system for assisting in diagnosis of brain dys- 

function in a subject, comprising: 

first means for concurrently recording N brainwave 
SP waveforms labelled SP; fir i=1...N from N 
locations at coordinates x;,yj,zj on the scalp of the 
subject, comprising EEG transducers; 

second means, coupled to the first means, for deter- 
mining three basis waveforms ΕΙ, f2, and f3 which 
provide the best fit of the function F,(x;,y;,z;) to the 
SP; waveforms, wherein: 


Fixiysizi)-—xfit-yifa-zifs--K 


where K is a waveform having a constant value; 

third means, coupled to the second means, for deter- 
mining N sets of determined coefficients x1; yl; 
zl; which each minimize a difference between F; 
and SP; 

fourth means, coupled to the third means, for storing 
a jth set of normative values for determined coeffi- 
cients; and 

fifth means, coupled to the third means, for compar- 
ing a jth set of the N sets of said determined coeffi- 
cients for a jth location xj Yj, zj}, on the scalp of the 
subject with the jth set of normative values for 
determined coefficients, wherein normative values 
are average values determined from a large popula- 
tion of subjects and said jth set of normative values 
are determined coefficients at scalp locations of the 
large population which correspond to said jth loca- 
tion on the scalp of the subject; 

means, coupled to the fifth means, for determining 
when differences between said jth set of said deter- 
mined coefficients and said jth set of normative 
values are larger than predetermined differences; 

wherein differences between said jth set of said deter- 
mined coefficients and said jth set of normative 

. values which are larger than predetermined differ- 
ences indicate brain dysfunction in a region of the 
brain that is adjacent to the jth location. 

18. A method for assisting in diagnosis of brain dys- 

function in a subject, comprising: 

concurrently recording N brainwave SP waveforms 
labelled SP; for i21... N from N locations at 
coordinates xj,yj,z;on the scalp of the subject, com- 
prising EEG transducers; 

determining three basis waveforms f|, {2, and f3 which 
provide the best fit of the function Fx; y;,z;) to the 
SP; waveforms, wherein: 


Fíxiyizi) -xifi--yifa4-zif3-- K 


where K is a waveform having a constant value; 

determining N sets of determined coefficients x1; yl; 
21, which each minimize a different between F; 
and SP; and 

storing a jth set of normative values for determined 
coefficients; 

comparing a jth set of the N sets of said determined 
coefficients for a jth location xj, yj, Ζ on the scalp 
of the subject with the jth set of normative values 
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for determined coefficients, wherein said norma- 
tive values are average values determined from a 
large population of subjects and said jth set of nor- 
mative values are determined coefficients at scalp 
locations of the large population which correspond 
to said jth location on the scalp of the subject, 
determining when differences between said jth set of 
said determined coefficients and said jth set of nor- 
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ences; 


wherein differences between said jth set of said deter- 
mined coefficients and said jth set of normative 
values which are larger than predetermined differ- 
ences indicate brain dysfunction in a region of the 
ent to the jth location. 


brain that 15 adjac 
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mative values are larger than predetermined differ- 
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